5. Edge Detection, Image Segmentation 
and Mathematical Morphologv 


* Chapter 7 (Image Segmentation) 
° Chapter 8 pp.518-528 (Morphologv) 


Edge Detection Using Derivative 
Operators 


Edges: the image portions which have large gradients 
Magnitude of the gradient 
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Extractio 
n via 
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(a) original 
b) vertical 
Sobel filteri 
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Sobel filter 
d) magnitude of 
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Cannv Edge Detector 


Reference: Canny, J.F., “A computational 
approach to edge detection,” /EEE Trans 
Pattern Analysis and Machine Intelligence, 


First Step 9 Smoothing 2986. 


The image is smoothed 
by Gaussian convolution 


- The larger the width of 
the Gaussian mask, the 
lower is the detector's 
sensitivity to noise. ES 


- The localization error in 115 
the detected edges 
also increases slightly 
as the Gaussian width 
is increased. 


Discrete approximation to Gaussian function with F—1.4 


Cannv Edge Detector 


Second Step—Find Edge 
Strength Sobel operator 


Find the edge 
strength by taking the 
gradient of the image 
The magnitude, or 
EDGE STRENGTH, of 
the gradient is then 
approximated: (Norm 
of the gradient) 


|G| = |Gx| + (бу! 


Cannv Edge Detector 


Third Step - Non-Maximum Suppression 
(Thinning) 


Localize the peaks of the gradient magnitude 
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Check if the pixel is а local maximum along the gradient 
direction 


- requires checking interpolated pixels p and г 


Cannv Edge Detector 
——_$_Fourth Step. 
Hysteresis 
If the threshold for the edges is too high, we 
have many broken lines; If too low, we have too 
many noise edges 


To resolve these problems, two thresholds are 
Set. 


Any pixel location that has a gradient value 
greater than the high threshold is assumed to 
be an edge pixel. 


Then, any pixels that are connected to this edge 
pixel and have a gradient value greater than the 
low threshold are also selected as edge pixels. 


Canny Edge Detector - An 
Experiment 
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Normof the After thinning After Hvsteresis 


gradient (non-maximum suppression) 
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Effect of c (Gaussian 
kernel size) 
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Original Canny with с = 1 Canny with c = 2 


The choice o6 depends on desired behavior 
- large? detects large scale edges 


- small? detects fine features ns 


Mathematical Morphologv 


J. Serra, Image Analvsis and Mathematical 
Morphologv, Academic Press, London, 1982. 


A range of поп-Ппеаг image processing techniques 
that deal with the shape or morphology of features 
in an image. 

The word morphology refers to form and structure. 


Most morphological techniques operate on binary 
inNQise faduction (without eliminating 
essential features) and feature detection 


- Analysis of connectivity of components 
- Object selection using geometric features 


- Post-processing for image segmentation - 


Basic Set Theorv 


abe 

de 
FIGURE 9.1 
(a) Two sets A 
and B. (b) The 
union of A and B. 
(c) The 
intersection of A 
and B. (d) The 
complement of A. 
(e) The difference 
between A and B. 
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Flementarv Operations 


Translatto (А) = іхјха+ z, for & A} 
Reflection A- /x[x-- a, for & Aj 
Complement’ = {x/¥ AJ 

Difference A-B-(x[x A, xx Bl-An B 


Structuring Elements 


Morphological operations use a small shape or 
template known as a structuring element (SE). 


The structuring element is positioned at all 
possible locations in the image and is compared 
to the corresponding neighborhood of pixels. 


Morphological operations differ in how they 
carry out this comparison. Some test whether 
the SE “fits” within the neighborhood, others 
test whether it “hits” or intersects the 
neighborhood. 


Structuring Elements 


The structuring element applied їо a 
binary image can be represented as a 
Small matrix of pixels, each with a 
value of 1 or 0. 


The dimensions of the matrix determine 
the size of the SE, and its shape is 
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Characteristics of an 
SE 


A structuring element has an origin (just like 
convolution mask). 

A SE is analogous to the kernel in convolution. 

The shape and size of the SE must be adapted to 
the geometric properties of the image objects of 
interest, i.e., an SE takes into account a number of 
factors: shape, siz^ ^r? ^н 


Disk SE examples " ш 


Basic Morphological Operations 


Erosion: shrinks or erodes a region: 


— It expands the holes enclosed bv a single region 
and make the gaps between different regions 
larger. 


Dilation: expands or dilates a region 


— It shrinks the holes enclosed by a single region 
and make the gaps between different regions 
smaller. 
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Erosion 
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Dilation 


he set of ай х such that : 
1e reflection of B about 

s origin and then 
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onzero element. 
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В: structuring element 


Erosion and Dilation 


Dilation 


Historicalty, certain computer 
programs were written using 
oniy two digits rather than 


four to define the appticable 
year. Accordingly, the 
company's software may 
recognize a date using "00" 
as 1900 rather than the vEa 
2000. 


Historically, certain computer 
programs were written using 
oniy two digits rather than 
four to define the applicable 
year. Accordingly, the 
company's software may 
recognize a date using "00" 
as 1900 rather than the yea 


FIGURE 9.5 

(a) Sample text of 
poor resolution 
with broken 
characters 
(magnified view). 
(b) Structuring 
element. 

(c) Dilation of (a) 
һу (b). Broken 
segments were 
joined. 


Compound Morphological 
Operations 


Combinations of the elementarv operations of 
erosion and dilation: 


Opening: use of erosion, followed ру dilation. 


— The effect is to smooth boundaries, to break narrow 
isthmuses, and to eliminate small noise regions. 


— Separate connected objects, remove small objects 


Closing: use of dilation, followed bv erosion. 


— The effect is to smooth boundaries, to join narrow 
breaks, and to fill small holes caused by noise. 


— Connect disconnected objects 


24 


Opening 


abt 


FIGURE 9.7 (a) Image of squares of size 1, 3, 5, 7, 9, and 15 pixels on the side. (b) Erosion of (a) with a square 
structuring element of T's, 13 pixels on the side. (c) Dilation of (b) with the same structuring element. 
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Opening 


Ege 
FIGURE 9.8 (a) Structuring element B "rolling" along the inner boundary of A (the dot 


indicates the origin of B). (c) The heavv line is the outer boundarv of the opening. 


(d) Complete opening (shaded). 
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Closing 


ab c 


FIGURE 9.9 (a) Structuring element B "rolling" on the outer boundary of set A. (b) Heavy 
line is the outer boundary of the closing. (c) Complete closing (shaded). 
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FIGURE 9.10 
Morphological 
opening and 
closing. The 
structuring 
element is the 
small circle shown 
in various 
positions in (b). 
The dark dot is 
the center of the 
structuring 
element. 


Opening and 


Closing 
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A‘ B=(A@B) B 
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Closing 


a | | sey 


| 
1 E 

,F x 

AS 


A 


"P = 


koma. Closing? F. 


4 | ч 


4 | 


1 
— 
jx y Ç / 
im. E t 


; à' Tauro ii 4 
í MEET. x 
ч š jis M 
` ww X 
=, xi —- 


Basic Morphological Operations 
e H HHH 
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Structuring Element: К 
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Opening Closing 


30 


Opening vs. Closing 


— Opening 15 used when the image has small 
regions to be removed. It is not used for 
narrow regions where there is a chance 
that the initial erosion operation might 
unintentionally disconnect the regions. 


— Closing is used when a region has become 
disconnected and the desire is to restore 
the connectivity. It is not used when 
different regions are located closely and 
the initial dilation might connect them. 
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Example (using a 3x3 structuring 
element) 


3 x 
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Segmentation Application Example 


Sprite coding 


33 


Fingerprint Image 
Enhancement 
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FIGURE 9.11 
(a) Noisv image. 
(c) Eroded image. 
(d) Opening of A. 
(d) Dilation of the 
opening. 
(e) Closing of the 
opening. (Original 
image for this 
example courtesy 
of the National 
Institute of 
Standards and 
Technology.) 


Some Basic Morphological 
Algorithms 


Hit-or-Miss Transformation 
Boundarv (Contour) Extraction 
Region Filling 

Extraction of Connected Components 
Convex Hull 

Thinning 

Thickening 

Skeletonization 


Pruning (reduces short branches 
extruding from a region after 
Skeletonization). 
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Hit-or-Miss Transform 


Serves to detect features in the 
image that match the shape of the 
structuring element. 

Requires a matched pair of SEs 
{B1,B2} that probe the inside and 
outsida ë g (ASB) AAS Bj age 
respec | 


Hit-or-Miss Transform 


Search for: 


How to find the match of Ain X Hit: the southwest quadrant must be black in X 
using a computer? 
origin 


Template B = 
Hit: the southwest quadrant must be black in X P Х| Х CB, 
Hit: the other three quadrants must be white in X = Hit: the other three quadrants must be black in X^ 
X — B 


Hit: the other three quadrants must be black in X* 


To satisfy both conditions, we need to take the 


: . Template В; 
Hit: the southwest quadrant must be black in X — 
mal origin Ч x X;-X OB; 


Template B intersection of X and X; 
Template B; 
Example 1 
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Hit-or-Miss Transform 


Identifv blobs with a radius of at 
least 2, but less than 4 in the pollen 
image. These regions totallv enclose 
a disc of radius 2, contained in the 5 
x b kernel named ''hit'. and in turn, 
fit within a hole of гасе? 
CO ' Original mage ` Вїпагу Image Objects with 2 < r«4 l 


Boundarv (Contour) 
Extraction 


One application of erosion Is 
contour extraction — the contours 
are extracted bv subtracting the 


eroded image fi#(4 =A- CA8B) al 


a b 
c d 


FIGURE 9.13 (a) Set 
A. (b) Structuring 
element В. (с) A 
eroded by B. 

(d) Boundary, given 
by the set 
difference between 
A and its erosion. 


Origin 


B(A) до 


Boundarv Extraction Example 


ab 


FIGURE 9.14 

(a) A simple 
binarv image, with 
l’s represented in 
white. (b) Result 
of using 

Eq. (9.5-1) with 
the structuring 
element їп 

Fig. 9.13(b). 
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Boundarv Extraction Example 
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Application of Skeletonization 
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TABLE 9.2 
Summarv of 
morphological 
operations and 
their properties. 


Operation 


Translation 
Reflection 
Complement 
Difference 
Dilation 
Erosion 


Opening 


Closing 


Equation 
(A), = {w|w = a + z, forae A} 
B = {w|w = —b, forbe В} 
A = {w|we¢ A) 
A — В = {w|we A, w e B) 
= А П B° 
АФВ = {z|(B), A B) 


AGB = (z|(B); C A} 


А°В= (АӨ В) ФВ 


A‘B = (АФВ) ӨВ 


Comments 
(The Roman numerals refer to the 


structuring elements shown in 
Fig. 9.26). 


‘Translates the origin 


of A to point z. 
Reflects all elements 
of B about the origin 
of this set. 
Set of points not in A. 


Set of points that belong 
to A but not to B. 


"Expands" the boundarv 
of A. (D 


"Contracts" the boundary 
of A. (1) 


Smoothes contours, 
breaks narrow isthmuses. 
and eliminates small 
islands and sharp 
peaks. (1) 

Smoothes contours, fuses 
narrow breaks and long 
thin gulfs, and eliminates 
small holes. (1) 


Hit-or-miss 
transform 


Boundary 
extraction 


Region filling 


Connected 
components 


Convex hull 


X, = (X, | B) ПА; X, = рапа 


= 1,2,3,... 


X, = (X, ФВ) А; Ху = pand 


k = 1,2,3,. 


Xi ier 9 BÝ) U A;i = 1,2,3,4; 
k 


= 1,2,3,...; Xo = A; and 


The set of points 


(coordinates) at which, 
simultaneously, B, found 
a match (“hit”) in A and 
В, found a match in A". 
set of points on the 
boundarv of 
set A. (T) 
Fills a region in A, given a 
point p in the region. (11) 
Finds a connected 
component Y in A, given 
a point p in Y. (1) 


Finds the convex hull C(A) 
of set A, where “conv” 
indicates convergence 
in the sense that 


Operation 


Thinning 


Thickening 


A8B-A- 


Equation 


(A® B) 
= Al (А © py. 


A8 {В} = 

((...((A@ B) OB)... )@B" 
(B] = (B, B^, BY... В"! 
AQB=AU(A®B) 


Comments 
(The Roman numerals refer to the 


structuring elements shown in 
Fig, 9.26). 


Thins set A. The first two 


equations give the basic 
definition of thinning. 
The last two equations 
denote thinning by a 
sequence of structuring 
elements. [his method 
is normally used in 
practice. (IV) 


Thickens set A. (See 


preceding comments on 
sequences of structuring 
elements.) Uses IV with 
('s and T's reversed. 


TABLE 9.2 
Summary of 
morphological 
resulls and their 
properties, 
(continued) 


Skeletons S(A) = | )5„(А) Finds the skeleton S( A) of 
к=п set A. The last equation 


4 — indicates that А can be 
"ede ЖАЫ айх reconstructed from its 
ян [CA eS, kB) = В|} skeleton subsets 5,( А). 
Eeċojistruttinii nb A: In all three equations, K is 
x the value of the iterative 
А = (JSA) Ф KH) step after which the set A 
k-0 erodes to the empty set. 


The notation (AC АВ) 
denotes the kth iteration 
Of successive erosion of 
A bv B.(I) 

Pruning X, = AG (B] X, is the result of pruning 


B , set A. Ihe number of 
(А, ә B') 
k=] 


х 
| 


times that the first 

X, = (x, Н\Г\ А equation is applied to 
ст | obtain X, must be 

X, = MU Xs specified. Structuring 

elements V are used for 

the first two equations. 

In the third equation 77 

denotes structuring 

element 1. 
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-1,2,3,4 - 
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FIGURE 9.26 Five basic types of structuring elements used for binary morphology. The 
origin of each element is at its center and the X's indicate "don t care” values. 


